Evaluating Term-Expansion for Unsupervised Image Annotation
نویسندگان
چکیده
Automatic image annotation (AIA) deals with the problem of automatically providing images with labels/keywords that describe their visual content. Unsupervised AIA methods are often preferred because they can annotate (virtually) any possible concept to images and do not require labeled data as their supervised counterparts. Unsupervised AIA methods use a reference collection of images with associated (unstructured, freeform) text to annotate images. Thus, this type of methods heavily rely on the quality of the text in the reference collection. With the goal of improving the annotation performance of unsupervised AIA methods, we propose in this paper a term expansion strategy that expands the text associated with images from the reference collection. The proposed method is based on term co-occurrence analysis. We evaluate the impact that the proposed expansion has in the annotation performance of a straight unsupervised AIA method using a benchmark for large scale image annotation. Two types of associated text are used and several image descriptors are considered. Experimental results show that, by using the proposed expansion, better annotation performance can be obtained, where the improvements depend on the type of associated text that is considered.
منابع مشابه
Fuzzy Neighbor Voting for Automatic Image Annotation
With quick development of digital images and the availability of imaging tools, massive amounts of images are created. Therefore, efficient management and suitable retrieval, especially by computers, is one of themost challenging fields in image processing. Automatic image annotation (AIA) or refers to attaching words, keywords or comments to an image or to a selected part of it. In this paper,...
متن کاملTags Re-ranking Using Multi-level Features in Automatic Image Annotation
Automatic image annotation is a process in which computer systems automatically assign the textual tags related with visual content to a query image. In most cases, inappropriate tags generated by the users as well as the images without any tags among the challenges available in this field have a negative effect on the query's result. In this paper, a new method is presented for automatic image...
متن کاملA Picture Is Worth a Thousand Tags: Automatic Web Based Image Tag Expansion
We present an approach to automatically expand the annotation of images using the internet as an additional information source. The novelty of the work is in the expansion of image tags by automatically introducing new unseen complex linguistic labels which are collected unsupervised from associated webpages. Taking a small subset of existing image tags, a web based search retrieves additional ...
متن کاملImage-Text Dataset Generation for Image Annotation and Retrieval
This paper presents a new dataset of images gathered from the Web with corresponding text obtained from the webpages near where the images appeared. Already extracted features are provided to ease the dataset usage for other researchers. An initial release of 250,000 images is targeted at automatic image annotation with unsupervised data. This dataset is the one being used for the ImageCLEF 201...
متن کامل